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Artificial  Intelligence:  Cognition  as  Computation1 

Avron  Barr 


Hie  ability  and  compulsion  to  know  are  as  characteristic  of  our  human  nature  as  arc  our  physical  posture 
and  our  languages.  Knowledge  and  intelligence,  as  scientific  concepts,  arc  used  to  describe  how  an  organism's 
experience  appears  to  mediate  its  behavior.  This  report  discusses  the  relation  between  artificial  intelligence 
(AI)  research  in  computer  science  and  the  approaches  of  other  disciplines  dial  study  the  nature  of  intelligence, 
cognition,  and  mind.  The  suite  of  Al  after  25  years  of  work  in  the  field  is  reviewed,  as  arc  the  views  of  its 
practitioners  about  its  relation  to  cognate  disciplines,  l’he  report  concludes  w  ith  a  discussion  of  some  possible 
effects  on  our  scientific  work  of  emerging  commercial  applications  of  Al  technology,  that  is,  machines  that 
can  know  and  can  take  part  in  human  cognitive  activities.  \ 

Artificial  Intelligence 

Artificial  intelligence  is  the  part  of  computer  science  concerned  with  creating  and  studying  computer 
programs  that  exhibit  behavioral  characteristics  we  identify  as  intelligent  in  human  behavior— knowing, 
reasoning,  learning,  problem  solving,  language  understanding,  and  so  on.  Since  die  field’s  emergence  in  the 
mid-1950s,  AI  researchers  have  developed  dozens  of  programs  and  programming  techniques  that  support 
some  sort  of  '‘intelligent”  behavior.  Although  there  are  many  attitudes  expressed  by  researchers  in  the  field, 
most  of  these  people  are  motivated  in  their  work  on  intelligent  computer  programs  by  the  thought  that  diis 
work  may  lead  to  a  new  understanding  of  mind: 

AI  has  also  embraced  die  larger  scientific  goal  of  constructing  an  information-processing  dicory  of 
intelligence.  If  such  a  science  of  intelligence  could  be  developed,  it  could  guide  die  design  of 
intelligent  machines  as  well  as  explicate  intelligent  behavior  as  it  occurs  in  humans  and  other 
animals.  (Nilsson,  1980,  p.  2) 


’To  appear  in  The  Study  of  Information:  Interdisciplinary  Messages,  edited  by  Iritz  Machlup  and  Una  Mansfield,  and  published  by 
John  Wiley  and  Sons,  New  York,  1983. 
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Whether  or  not  it  leads  to  a  better  understanding  of  the  mind,  there  is  every  evidence  that  current  work 
in  Al  will  lead  to  a  new  intelligent  technology  that  may  have  dramatic  effects  on  our  society.  Kxpcrimcntal  AI 
systems  have  already  generated  interest  and  enthusiasm  in  industry  and  arc  being  developed  commercially. 
These  experimental  systems  include  programs  that — 

•  solve  some  hard  problems  in  chemistry,  biology,  geology,  engineering,  and  medicine  at  human- 
expert  levels  of  performance; 

•  manipulate  robotic  devices  to  perform  some  useful  sensory-motor  tasks;  and 

•  answer  questions  posed  in  restricted  dialects  of  English  (French,  Japanese,  etc.). 

Useful  AI  programs  will  play  an  important  part  in  the  evolution  of  the  role  of  computers  in  our  lives — a  role 
that  has  changed,  in  our  lifetimes,  from  remote  to  commonplace  and  that,  if  current  expectations  about 
computing  cost  and  power  arc  correct,  is  likely  to  evolve  further  from  useful  to  essential. 


The  Origins  of  Artificial  Intelligence 

Scientific  fields  emerge  as  the  concerns  of  scientists  congeal  around  various  phenomena.  Sciences 
are  not  defined,  they  arc  recognized.  (Newell,  1973a.  p.  1) 

The  intellectual  currents  of  the  times  help  direct  scientists  to  the  study  of  certain  phenomena.  For  the 

evolution  of  AI,  the  two  most  important  forces  in  the  intellectual  environment  of  the  1930s  and  1940s  were 

mathematical  logic,  which  had  been  under  rapid  development  since  the  end  of  the  19th  century,  and  new 

ideas  about  computation.  The  logical  systems  of  Frege.  Whitehead  and  Russell.  Tarski,  and  others  showed 

that  some  aspects  of  reasoning  could  be  formalized  in  a  relatively  simple  framework: 

Ihc  fundamental  contribution  was  to  demonstrate  by  example  that  the  manipulation  of  symbols 
(at  least  some  manipulation  of  some  symbols)  could  be  described  in  terms  of  specific,  concrete 
processes  quite  as  readily  as  could  the  manipulation  of  pine  boards  in  a  carpenter  shop. . . .  Formal 
logic,  if  it  showed  nothing  else,  showed  that  ideas — at  least  some  ideas — could  be  represented  by 
symbols,  and  that  these  symbols  could  be  altered  in  meaningful  ways  by  precisely  defined 
processes.  (Newell  and  Simon,  1972,  p.  877) 

Mathematical  logic  continues  to  be  an  active  area  of  investigation  in  A  I,  in  part  because  general-purpose, 
logico-dcductivc  systems  have  been  successfully  implemented  on  computers.  But  even  before  the  advent  of 
computers,  the  mathematical  formalization  of  logical  reasoning  shaped  people's  conception  of  the  relation 
between  computation  and  intelligence. 


Ideas  about  the  nature  of  computation,  due  to  Church,  Turing,  and  others,  provided  the  link  between  the 
notion  of  formalization  of  reasoning  and  the  computing  machines  about  to  be  invented.  What  was  essential  in 


this  work  was  the  abstract  conception  of  computation  as  symbol  processing.  The  first  computers  were 

numerical  calculators  that  did  not  appear  to  embody  much  intelligence  at  all.  Hut  before  these  machines  were 

even  designed.  Church  and  l  uring  had  seen  that  numbers  were  an  inessential  aspect  of  computation — they 

were  just  one  way  of  interpreting  the  internal  states  of  die  machine: 

In  their  striving  to  handle  symbols  rigorously  and  objectively — as  objects— logicians  became  more 
and  more  explicit  in  describing  the  processing  system  diat  was  supposed  to  manipulate  the 
symbols.  In  1936.  Alan  l  uring,  an  I'.nglish  logician,  described  the  processor,  now  known  as  the 
Turing  machine,  dial  is  regarded  as  die  culmination  of  this  drive  toward  formalization.  (Newell 
and  Simon,  1972.  p.  878) 

lire  model  of  a  Turing  machine  contains  within  it  die  notions  both  of  what  can  be  computed  and 
of  universal  machines— computers  that  can  do  anything  diat  can  be  done  by  any  machine. 
(Newell  and  Simon,  1976,  p.  117) 

Turing,  who  has  been  called  the  father  of  Al,  not  only  invented  a  simple,  universal,  and  nonnumcrical  model 
of  computation  but  also  argued  directly  for  the  possibility  that  computational  mechanisms  could  behave  in  a 
way  that  would  be  perceived  as  intelligent: 

'fhought  was  still  wholly  intangible  and  ineffable  until  modern  formal  logic  interpreted  it  as  the 
manipulation  of  formal  tokens.  And  it  seemed  still  to  inhabit  mainly  the  heaven  of  Platonic  ideals, 
or  the  equally  obscure  spaces  of  the  human  mind,  until  computers  taught  us  how  symbols  could  be 
processed  by  machines.  A.  M.  l  uring  .  .  .  made  his  great  contributions  at  the  mid-century 
crossroads  of  these  developments  diat  led  from  modern  logic  to  the  computer.  (Newell  and 
Simon.  1976,  p.  125) 

As  Allen  Newell  and  Herbert  Simon  point  out  in  the  "Historical  Kpiloguc"  to  their  classic  work  Human 
Problem  Solving  (1972),  there  were  other  strong  intellectual  currents  from  sev  eral  directions  that  converged  in 
the  middle  of  diis  century  in  the  people  who  founded  the  science  of  artificial  intelligence.  Ihe  concepts  of 
cybernetics  and  self-organizing  systems  of  Wiener,  McCulloch,  and  others  dealt  with  die  macroscopic 
behavior  of  “locally  simple"  systems.  The  cyberneticians  influenced  many  fields  because  dicir  diinking 
spanned  many  fields,  linking  ideas  about  the  workings  of  die  nervous  system  with  information  theory  and 
control  theory,  as  well  as  with  logic  and  computation.  Their  ideas  were  part  of  die  Zeitgeist,  but  in  many  eases 
the  cyberneticians  influenced  early  workers  in  A I  more  directly — as  dicir  teachers. 

What  eventually  connected  these  diverse  ideas  was.  of  course,  the  development  of  the  computing 
machines  themselves,  conceived  by  Babbage  and  guided  in  diis  century  by  Turing,  von  Neumann,  and  others. 
It  was  not  long  after  the  machines  became  available  that  people  began  to  try  to  write  programs  to  solve 
puzzles,  play  chess,  and  translate  texts  from  one  language  to  another— the  first  A I  programs. 


4 


What  was  it  about  computers  that  triggered  die  development  of  A  I?  Many  ideas  about  computing 

relevant  to  AI  emerged  in  the  early  designs — ideas  about  memories  and  processors,  about  systems  and 

control,  and  about  levels  of  languages  and  programs.  But  the  single  attribute  of  die  new  machines  that 

brought  about  die  emergence  of  die  new  science  was  their  inherent  potential  for  complexity,  encouraging  (in 

several  fields)  the  development  of  new  and  more  direct  ways  of  describing  complex  processes— in  terms  of 

complicated  data  structures  and  procedures  with  hundreds  of  different  steps: 

Problem  solving  behaviors,  even  in  the  relatively  well-structured  task  environments  that  we  have 
used  in  our  research,  have  generally  been  regarded  as  highly  complex  forms  of  human 
behavior — so  complex  that  for  a  whole  generation  diey  were  usually  avoided  in  the  psychological 
laboratory  in  favor  of  behaviors  that  seemed  to  be  simple.  .  .  .  The  appearance  of  the  modern 
computer  at  the  end  of  World  War  II  gave  us  and  other  researchers  die  courage  to  return  to 
complex  cognitive  performances  as  our  source  of  data  ...  a  device  capable  of  symbol- 
manipulating  behavior  at  levels  of  complexity  and  generality  unprecedented  for  man-made 
mechanisms.  .  .  .  This  was  part  of  the  general  insight  of  cybernetics,  delayed  by  ten  years  and 
applied  to  discrete  symbolic  behavior  radier  than  to  continuous  feedback  systems.  (Newell  and 
Simon,  1972.  pp.  869-870) 


Computers,  Complexity,  and  Intelligence 

As  Pamela  McCorduck  notes  in  her  entertaining  historical  study  of  Al  Machines  Who  Think  (1979),  there 
has  been  a  longstanding  connection  between  die  idea  of  complex  mechanical  devices  and  intelligence. 
Starting  with  the  fabulously  intricate  clocks  and  mechanical  automata  of  past  centuries,  people  have  made  an 
intuitive  link  between  the  complexity  of  a  machine's  operation  and  some  aspects  of  dieir  own  mental  life. 
Over  the  last  few  centuries,  new  technologies  have  resulted  in  a  dramatic  increase  in  the  complexity  we  can 
achieve  in  the  things  we  build.  Modern  computer  systems  arc  more  complex  by  several  orders  of  magnitude 
than  anything  humans  have  built  before. 

The  first  work  on  computers  in  this  century  focused  on  the  numerical  computations  that  had  previously 
been  performed  collaborativcly  by  teams  of  hundreds  of  clerks,  organized  so  that  each  did  one  small 
subcalculation  and  passed  the  results  on  to  the  clerk  at  the  next  desk.  Not  long  after  the  dramatic  success  of 
the  first  digital  computers  with  these  elaborate  calculations,  people  began  to  explore  the  possibility  of  more 
generally  intelligent  mechanical  behavior — could  machines  play  chess,  prove  theorems,  or  translate 
languages?  They  could,  but  not  very  well.  The  computer  performs  its  calculations  following  the  step-by-step 
instructions  it  is  given— the  method  must  be  specified  in  complete  detail.  Most  computer  scientists  are 
concerned  with  designing  new  algorithms,  new  languages,  and  new  machines  for  performing  tasks  like  solving 


equations  and  alphabetizing  lists — tasks  that  people  perform  using  methods  they  can  explicate.  However, 
people  cannot  specify  how  they  decide  which  move  to  make  in  a  game  of  chess  or  how  they  determine  that 
two  sentences  “mean  the  same  thing.” 

Hie  realization  that  the  detailed  steps  of  almost  all  intelligent  human  activity  were  unknown  marked  the 
beginning  of  artificial  intelligence  as  a  separate  part  of  computer  science.  Al  researchers  investigate  different 
kinds  of  computation,  and  different  ways  of  describing  computation,  in  an  attempt  not  just  to  create 
intelligent  artifacts  but  also  to  understand  what  intelligence  is.  A  basic  tenet  of  AI  is  that  human  intellectual 
capacity  will  best  be  described  in  the  same  terms  as  the  ones  researchers  invent  to  describe  their  programs. 
However,  they  are  just  beginning  to  learn  enough  about  those  programs  to  know  how  to  describe  them 
scientifically — in  terms  of  concepts  that  illuminate  their  nature  and  differentiate  among  fundamental 
categories.  These  ideas  about  computation  have  been  developed  in  programs  that  perform  many  different 
tasks,  sometimes  at  die  level  of  human  performance,  often  at  a  much  lower  level.  Most  of  these  methods  arc 
obviously  not  die  same  as  die  ones  that  people  use  to  perform  the  tasks— some  of  them  might  be. 

The  Status  of  Artificial  Intelligence 

Many  intelligent  activities  besides  numerical  calculation  and  information  retrieval  have  been  carried  on 
by  programs.  Many  key  aspects  of  thought — like  recognizing  people's  faces  and  reasoning  by  analogy — are 
still  puzzles;  they  are  performed  so  unconsciously  by  people  that  adequate  computational  mechanisms  have 
not  been  postulated.  Some  of  the  successes,  as  well  as  some  of  the  failures,  have  come  as  surprises.  We  will 
list  here  some  of  die  aspects  of  intelligence  investigated  in  AI  research  and  try  to  give  an  indication  of  die 
stage  of  progress. 

There  is  an  important  philosophical  point  here  that  will  be  sidestepped.  Doing  aridimctic  or  learning  die 
capitals  of  all  the  countries  of  the  world,  for  example,  arc  certainly  activities  that  indicate  intelligence  in 
humans.  The  issue  here  is  whether  a  computer  system  that  can  perform  these  tasks  can  be  said  to  know  or 
understand  anything.  This  point  has  been  discussed  at  length  (see,  c.g„  Scarlc,  1980,  and  appended 
commentary)  and  will  Je  avoided  here  by  describing  the  behaviors  themselves  as  intelligent,  without 
commitment  as  to  how  to  describe  the  machines  that  produce  diem. 

Problem  solving.  The  first  big  “successes"  in  AI  were  programs  that  could  solve  puzzles  and  play  games. 
Techniques  such  as  looking  ahead  several  moves  and  dividing  difficult  problems  into  easier  subproblcms 
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evolved,  respectively,  into  the  fundamental  Al  techniques  of  search  and  problem  reduction.  Today’s  programs 
play  championship-level  checkers  and  backgammon,  as  well  as  very  good  chess.  Another  problem-solving 
program,  the  one  that  does  symbolic  evaluation  of  mathematical  functions,  performs  very  well  and  is  being 
used  widely  by  scientists  and  engineers.  Some  programs  can  even  improve  their  own  performance  with 
experience. 

As  discussed  below,  the  open  questions  in  this  area  involve  abilities  that  human  players  exhibit  but 
cannot  articulate,  such  as  the  chess  master's  ability  to  see  the  board  configuration  in  terms  of  meaningful 
patterns.  Another  basic  open  question  involves  the  original  conceptualization  of  a  problem,  called  in  Al  the 
choice  of  problem  representation.  Humans  often  solve  a  problem  by  finding  a  way  of  thinking  about  it  that 
makes  the  solution  easy;  Al  programs,  so  far,  must  be  told  how  to  think  about  the  problems  they  solve  (i.c.. 
the  space  in  which  to  search  for  the  solution). 

Logical  reasoning.  Closely  related  to  problem  and  puzzle  solving  was  early  work  on  logical  deduction. 
Programs  were  developed  that  could  "prove"  assertions  by  manipulating  a  data  base  of  facts,  each  represented 
by  discrete  data-stnicturcs  just  as  they  are  represented  by  formulas  in  mathematical  logic.  These  methods, 
unlike  many  other  Al  techniques,  could  be  shown  to  be  complete  and  consistent.  That  is,  given  a  set  of  facts, 
the  programs  theoretically  could  prove  all  theorems  that  followed  from  the  facts,  and  only  those  theorems. 
Logical  reasoning  has  been  one  of  the  most  persistently  investigated  subareas  of  A I  research.  Of  particular 
interest  arc  the  problems  of  finding  ways  of  focusing  on  only  the  relevant  facts  from  a  large  data  base  and  of 
keeping  track  of  the  justifications  for  beliefs  and  updating  them  when  new  information  arrives. 

Programming.  Although  perhaps  not  an  obviously  important  aspect  of  human  cognition,  programming 
itself  is  an  important  area  of  research  in  Al.  Work  in  this  area,  called  automatic  programming,  has  investigated 
systems  that  can  write  computer  programs  from  a  variety  of  descriptions  of  their  purpose,  such  as  examples  of 
input/output  pairs,  high-level  language  descriptions,  and  even  F.nglish-languagc  descriptions  of  algorithms. 
Progress  has  been  limited  to  a  few,  fully  worked-out  examples.  Automatic-programming  research  may  result 
not  only  in  semiautomated  systems  for  software  development  but  also  in  Al  programs  that  learn  (i.c.,  modify 
their  behavior)  by  modifying  their  own  code.  Related  work  in  the  theory  of  programs  is  fundamental  to  all  Al 
research. 

language.  The  domain  of  language  understanding  was  also  investigated  by  early  Al  researchers  and  has 
consistently  attracted  interest.  Programs  have  been  written  that  retrieve  information  from  a  data  base  in 


7 


response  to  questions  posed  in  Knglish,  that  translate  sentences  from  one  language  to  another,  dial  follow 
instructions  or  paraphrase  statements  given  in  Rnglish,  and  that  acquire  knowledge  by  reading  textual 
material  and  building  an  internal  data  base.  Some  programs  have  even  achieved  limited  success  in 
interpreting  instructions  that  arc  spoken  into  a  microphone  rather  than  typed  into  the  computer.  Although 
these  language  systems  are  not  nearly  so  good  as  people  are  at  any  of  these  tasks,  they  arc  adequate  for  some 
applications.  Isarly  successes  with  programs  that  answered  simple  queries  and  followed  simple  directions,  and 
early  failures  at  machine-translation  attempts,  have  resulted  in  a  sweeping  change  in  the  w  hole  A1  approach  to 
language.  The  principal  themes  of  current  language-understanding  research  arc  the  importance  of  -t 
amounts  of  knowledge  about  the  subject  being  discussed  and  the  role  of  expectations,  based  on  die  si  :t 
matter  and  the  conversational  situation,  in  interpreting  sentences.  The  state  of  die  art  of  practical  lang  o 
programs  is  represented  by  useful  "front  ends”  to  a  variety  of  software  systems.  These  programs  accept 
only  in  some  restricted  form;  they  cannot  handle  some  of  the  nuances  of  Knglish  grammar  and  arc  useful  .01 
interpreting  sentences  only  within  a  relatively  limited  domain  of  discourse.  Although  there  has  been  very 
limited  success  at  translating  AI  results  in  language  and  speech-understanding  programs  into  ideas  about  die 
nature  of  human  language  processing,  the  realization  of  the  importance  in  language  understanding  of 
extensive  background  knowledge,  and  of  the  contextual  setting  and  intentions  of  die  speakers,  has  changed 
our  notion  of  w  hat  language  or  a  dicory  of  language  might  be. 

/. earning.  Certainly  one  of  the  most  significant  aspects  of  human  intelligence  is  our  ability  to  learn. 
However,  this  is  an  example  of  cognitive  behavior  that  is  so  poorly  understood  that  very  little  progress  has 
been  made  in  accomplishing  it  in  AI  systems.  Although  there  have  been  several  interesting  attempts  at  diis, 
including  programs  that  learn  from  examples,  from  their  own  performance,  or  from  advice  from  others.  AI 
systems  do  not  exhibit  noticeable  learning. 

Robotics  and  vision.  One  area  of  AI  research  that  is  receiving  increasing  attention  involves  programs  that 
manipulate  robot  devices.  Research  in  this  field  has  looked  at  everything  from  the  optimal  movement  of 
robot  arms  to  methods  of  planning  a  sequence  of  actions  to  achieve  a  robot's  goals.  Some  robots  “see" 
through  a  TV  camera  that  transmits  an  array  of  information  back  to  the  computer.  The  processing  of  visual 
information  is  another  very  active,  and  very  difficult,  area  of  AI  research.  Programs  have  been  developed  that 
can  recognize  objects  and  shadows  in  visual  scenes,  and  even  identify  small  changes  from  one  picture  to  the 
next,  for  example,  for  aerial  reconnaissance.  The  true  potential  of  this  research,  however,  is  that  it  deals  with 
artificial  intelligences  in  perceived  and  manipulate  environments  similar  to  our  own. 
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Systems  and  languages.  In  addition  to  work  directly  aimed  at  achieving  intelligence,  the  development  of 
new  tools  has  always  been  an  important  aspect  of  A I  research.  Some  of  die  most  important  contributions  of 
A1  to  die  world  of  computing  have  been  in  the  form  of  spin-offs.  Computer-systems  ideas  like  timesharing, 
list  processing,  and  interactive  debugging  were  developed  in  die  A1  research  environment.  Specialized 
programming  languages  and  systems,  with  features  designed  to  facilitate  deduction,  robot  manipulation, 
cognitive  modeling,  and  so  on,  have  often  been  rich  sources  of  new  ideas.  Most  recent  among  these  has  been 
the  many  know  ledge- representation  languages.  These  are  computer  languages  for  encoding  knowledge  as 
data  structures  and  reasoning  methods  as  procedures,  developed  over  the  last  five  years  to  explore  a  variety  of 
ideas  about  how  to  build  reasoning  programs.  Terry  Winograd's  1979  article  "Beyond  Programming 
languages"  discusses  some  of  his  ideas  about  the  future  of  computing,  inspired  in  part  by  his  research  on  A I. 

Expert  systems,  f  inally,  the  area  of  "expert,"  or  "knowledge-based,"  systems  has  recently  emerged  as  a 
likely  area  for  useful  applications  of  Al  techniques  (feigenbaum.  1977).  Typically,  die  user  interacts  with  an 
expert  system  in  a  form  of  consultation  dialogue,  just  as  he  (or  she)  would  interact  with  a  human  expert  in  a 
particular  area:  explaining  his  problem,  performing  suggested  tests,  and  asking  questions  about  proposed 
solutions.  Current  experimental  systems  have  performed  very  well  in  consultation  tasks  like  chemical  and 
geological  data  analysis,  computer-system  configuration,  completion  of  income  tax  forms,  and  even  medical 
diagnosis,  f.xpert  systems  can  be  viewed  as  intermediaries  between  human  experts,  who  interact  with  the 
systems  in  knowledge-acquisition  mode,  and  human  users,  who  interact  with  the  systems  in  consultation  moue. 
furthermore,  much  research  in  this  area  of  Al  has  focused  on  providing  these  systems  with  the  ability  to 
explain  their  reasoning,  both  to  make  the  consultation  more  acceptable  to  the  user  and  to  help  the  human 
expert  locate  the  cause  of  errors  in  the  sy  stem's  reasoning  w  hen  they  occur. 

Because  its  imminent  commercial  applications  arc  indicative  of  important  changes  in  the  field,  much  of 
die  ensuing  discussion  of  the  role  of  Al  in  the  study  of  mind  will  refer  to  the  expert-systems  research.  That 
these  systems 

•  “represent”  vast  amounts  of  knowledge  obtained  from  human  experts, 

•  arc  used  as  tools  to  solve  difficult  problems  using  this  knowledge, 

•  can  be  viewed  as  intermediaries  between  human  problem  solvers, 

•  must  explain  their  “thought  processes"  in  terms  that  people  can  understand,  and 

•  arc  worth  a  lot  of  money  to  people  with  real  problems 
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arc  the  essential  points  that  will  be  true  of  all  of  Al  someday,  in  fact,  of  computers  in  general,  and  will  change 
the  role  that  AI  research  plays  in  the  scientific  study  of  thought. 

Open  problems.  Although  there  have  been  much  activity  and  progress  in  the  25-year  history  of  A  I.  some 
very  central  aspects  of  cognition  have  not  yet  been  achieved  by  computer  programs.  Our  abilities  to  reason 
about  others'  beliefs,  to  know  die  limits  of  our  knowledge,  to  visualize  things,  to  be  "reminded”  of  relevant 
events,  to  learn,  to  reason  by  analogy,  and  to  make  plausible  inferences,  realize  when  they  arc  wrong,  and 
know  how  to  recover  from  them  are  not  at  all  understood. 

It  is  a  fact  that  these  and  many  other  fundamental  cognitive  capabilities  may  remain  problematic  for  some 
time.  But  it  is  also  a  fact  dial  computer  programs  have  successfully  achieved  a  level  of  performance  on  a 
range  of  “intelligent"  behaviors  unmatched  by  anything  other  than  die  human  brain.  Al's  failure  to  provide 
some  seemingly  simple  cognitive  capabilities  in  computer  programs  becomes,  in  die  view  of  Al  to  be 
presented  in  this  paper,  part  of  the  set  of  phenomena  to  be  explained  by  die  new  science. 

AI  and  tlie  Study  of  Mind 

Al  research  in  problem  solving,  language  processing,  and  so  forth  has  produced  some  impressive  and 
useful  computer  systems.  It  has  also  influenced,  and  been  influenced  by.  research  in  many  other  fields. 
What,  then,  is  the  relation  between  A I  and  the  other  disciplines  that  study  the  various  aspects  of  mind,  for 
example,  psychology,  linguistics,  philosophy,  and  sociology? 

Al  certainly  has  a  unique  method — designing  and  testing  computer  programs — and  a  unique 
goal— making  those  programs  seem  intelligent.  It  has  been  argued  from  time  to  time  dial  diesc  attributes 
make  Al  independent  of  the  other  disciplines: 

Artificial  Intelligence  was  an  attempt  to  build  intelligent  machines  without  any  prejudice  toward 
making  the  system  simple,  biological,  or  humanoid.  (Minsky,  1968,  p.  7) 

But  one  docs  not  start  from  scratch  in  building  the  first  program  to  accomplish  some  intelligent  behavior:  the 

ideas  about  how  that  program  is  to  work  must  come  from  somewhere.  Furthermore,  most  Al  researchers  are 

interested  in  understanding  the  human  mind  and  actively  seek  hints  about  its  nature  in  their  experiments  with 

their  programs. 

The  interest  within  Al  in  the  results  and  open  problems  of  other  disciplines  has  been  fully  reciprocated 
by  interest  in  and  application  of  AI  research  activity  among  researchers  in  other  fields.  Many  experimental 


10 


and  theoretical  insights  in  psychology  and  linguistics,  at  least,  have  been  sparked  by  A1  techniques  and  results. 
Furthermore,  this  flow  is  likely  to  increase  dramatically  in  the  future;  its  source  is  the  variety  of  new 
phenomena  displayed  by  Al  systems— the  number,  quality,  utility.  >nd  level  of  activity  of  which  will  soon 
dramatically  increase.  Hut  first  let  us  examine  wh.it  kind  of  interactions  have  taken  place  between  A I  and  the 
other  disciplines. 

The  Language  of  Computation 

As  we  defined  it  at  the  outset,  Al  is  a  branch  of  computer  science.  Its  practitioners  are  trained  in  the 
various  subftelds  of  computer  science:  formal  computing  theory,  algorithm  design,  hardware  and  operating- 
systems  architecture,  programming  languages,  and  programming.  I  he  study  of  each  of  these  subareas  has 
produced  a  language  of  its  own.  indicating  our  understanding  of  die  important  known  phenomena  of 
computing.  The  underlying  assumption  of  our  research  is  that  this  language  (which  involves  concepts  like 
process,  procedure,  interpreter,  bottom-up  and  top-down  processing,  object-oriented  programming,  and 
trigger)  and  the  experience  with  computation  that  it  embodies  will,  in  turn,  assist  us  in  understanding  the 
various  phenomena  of  mind. 

Before  we  go  on  to  discuss  the  utility  of  these  computational  concepts,  it  should  be  stated  that,  in  fact,  our 
understanding  of  computation  itself  is  quite  limited.  Von  Neumann  (1958)  dreamed  of  an  "information 
theory"  of  the  nature  of  thinking; 

ITie  body  of  experience  which  has  grown  up  around  the  planning,  evaluating,  and  coding  of 
complicated  logical  and  mathematical  automata  will  be  the  focus  of  much  of  this  information 
theory.  ...  It  would  be  very  satisfactory  if  one  could  talk  about  a  "theory"  of  such  automata. 
Regrettably,  what  at  this  moment  exists — and  to  what  I  must  appeal — can  as  yet  be  described  only 
as  an  imperfectly  articulated  and  hardly  formalized  "body  of  experience."  (p.  2) 

And  ten  years  later,  in  their  superb  treatise  on  perceptronlike  automata.  Minsky  and  Papcrt  (l%9)  lament: 

We  know  shamefully  little  about  our  computers  and  their  computations.  . .  .  We  know  very  little, 
for  instance,  about  how  much  computation  a  job  should  require. . . .  The  immaturity  shown  by  our 
inability  to  answer  questions  of  this  kind  is  exhibited  even  in  the  language  used  to  formulate  the 
questions.  Word  pairs  such  as  "parallel"  vs.  "serial,"  "local"  vs.  "global."  and  "digital"  vs. 
"analog"  are  used  as  if  they  referred  to  well-defined  technical  concepts,  liven  when  this  is  true, 
the  technical  meaning  varies  from  user  to  user  and  context  to  context.  Hut  usually  they  are  treated 
so  loosely  that  the  species  of  computing  machine  defined  by  them  belongs  to  mythology  rather 
than  science,  (pp.  1-2) 

ITicrc  is  still  no  adequate  theory  of  computation  for  understanding  the  nature  and  scope  of  symbolic 
processes,  but  there  is  rapidly  accumulating  experience  with  computation  of  .ill  sorts— useful  new  concepts 
emerge  continually. 
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The  Computational  Metaphor 

The  discipline  most  closely  related  to  AI  is  cognitive  psychology.  These  two  disciplines  deal  primarily 
with  the  same  kinds  of  behaviors — perception,  memory,  problem  solving.  And  they  arc  siblings:  Modern 
cognitive  psychology  emerged  from  its  behavior-oriented  precursors  in  conjunction  with  the  rise  of  AI.  That 
there  might  be  a  relation  between  the  new  field  of  AI  and  die  traditional  interests  of  psychologists  was  evident 
from  the  beginning: 

Our  fundamental  concern  was  to  discover  whether  the  cybernetic  ideas  have  any  relevance  for 
psychology.  The  men  who  have  pioneered  in  this  area  have  been  remarkably  innocent  of 
psychology  . . . .  There  must  be  some  way  to  phrase  the  new  ideas  so  that  they  can  contribute  to  and 
profit  from  the  science  of  behavior  that  psychologists  have  created.  (Miller.  Galantcr.  and 
Pribram,  1960,  p.  3) 

What  in  fact  happened  was  that  the  existence  of  computing  served  as  an  inspiration  to  traditional 

psychologists  to  begin  to  theorize  in  terms  of  internal,  cognitive  mechanisms.  Lise  of  the  concepts  of 

computation  as  metaphors  for  the  processes  of  the  mind  strongly  influenced  the  form  of  modern  theories  of 

cognitive  psychology — for  example,  theories  expressed  in  terms  of  memories  and  retrieval  processes: 

Computers  accept  information,  manipulate  symbols,  store  items  in  "memory"  and  retrieve  them 
again,  classify  inputs,  recognize  patterns,  and  so  on.  W  hether  they  do  these  things  just  like  people 
was  less  important  than  dial  they  do  them  at  all.  The  coming  of  the  computer  provided  a 
much-needed  reassurance  dial  cognitive  processes  were  real.  (Neisscr.  1976,  p.  5) 

The  metaphorical  use  of  die  language  of  computation  in  describing  mental  processes  w  as  found  to  be.  at 

least  for  a  time,  quite  fertile  ground  for  sprouting  psychological  theories. 

During  a  period  of  concept  formation,  we  must  be  well  aware  of  the  metaphorical  nature  of  our 
concepts.  However,  during  a  period  in  which  die  concepts  can  accommodate  most  of  our 
questions  about  a  given  subject  matter,  we  can  afford  to  ignore  their  metaphorical  origins  and 
confuse  our  description  of  reality  with  diat  reality.  (Arbib,  1972,  p.  11) 

When  pioneering  work  by  Newell.  Shaw,  and  Simon  and  by  other  research  ..roups  showed  that 

“programming  up"  their  intuitions  about  how  humans  solve  puzzles,  find  theorems,  and  so  on  was  adequate 

to  get  impressive  results,  the  link  between  the  study  of  human  problem-solving  and  AI  research  was  firmly 

established. 

Consider,  for  example,  computer  programs  dial  play  chess.  Current  programs  arc  quite  proficient— the 
best  experimental  systems  play  at  the  human  “expert"  level,  but  not  as  well  as  human  chess  “masters."  Hie 
programs  work  by  searching  through  a  space  of  possible  moves,  that  is,  considering  the  alternative  moves  and 
their  consequences  several  steps  ahead  in  die  game,  just  as  human  players  do.  These  programs,  even  some  of 


the  earliest  versions,  could  search  through  thousands  of  moves  in  the  time  it  takes  human  players  to  consider 
only  a  dozen  or  so  alternatives.  The  theory  of  optimal  search,  developed  as  a  mathematical  formalism 
(paralleling,  as  a  matter  of  fact,  much  of  the  work  on  optimal  decision  theory  in  operations  research) 
constitutes  some  of  die  core  ideas  of  Al. 

The  reason  that  computers  cannot  beat  the  best  human  players  is  that  looking  ahead  is  not  all  there  is  to 
chess.  Since  there  are  too  many  possible  moves  to  search  exhaustively,  even  on  the  fastest  imaginable 
computers,  alternative  moves  (board  positions)  must  be  evaluated  w ithout  knowing  for  sure  which  move  will 
lead  to  a  winning  game,  and  this  is  one  of  those  skills  that  human  chess  experts  cannot  make  explicit. 
Psychological  studies  have  shown  dial  chess  masters  have  learned  to  see  thousands  of  meaningful 
configurations  of  pieces  when  they  look  at  chess  positions,  which  presumably  helps  them  decide  on  the  best 
move,  but  no  one  has  yet  suggested  how  to  design  a  computer  program  that  can  identify  these  configurations. 

I 'or  die  lack  of  dieory  or  intuitions  about  human  perception  and  learning,  Al  progress  on  computer  chess 
has  virtually  stopped,  but  it  is  quite  possible  that  new  insights  into  a  very  general  problem  were  gained.  The 
computer  programs  had  pointed  up,  more  clearly  than  ever,  what  would  be  useful  for  a  cognitive  system  to 
learn  to  see.  It  takes  many  years  for  chess  experts  to  develop  their  expertise— their  ability  to  "understand”  the 
game  in  terms  of  such  concepts  and  patterns  dial  they  cannot  explain  easily,  if  at  all.  The  general  problem  is 
of  course,  to  determine  what  it  is  about  our  experience  that  we  apply  to  future  problem  solving:  What  kind  of 
knowledge  do  we  glean  from  our  experience?  The  work  on  chess  indicated  some  of  the  demands  that  would 
be  placed  on  this  knowledge. 

Language  Translation  and  Linguistics 

Ideas  about  getting  computers  to  deal  in  some  useful  way  with  the  human  languages,  called  “natural" 
languages  by  computer  scientists,  were  conceived  before  any  machines  were  ever  built.  Hie  first  line  of  attack 
was  to  try  to  use  large,  bilingual  dictionaries  stored  in  die  computers  to  translate  sentences  from  one  language 
to  another  (Harr  and  Kcigcnbaum,  1981,  pp.  233-238),  The  machine  would  look  up  the  translation  of  the 
words  in  the  original  sentence,  figure  out  the  "meaning"  of  the  sentence  (perhaps  expressed  in  some 
interlingua).  and  produce  a  syntactically  correct  version  in  the  target  language. 

It  did  not  work.  It  became  apparent  early  on  that  processing  language  in  any  useful  way  involved 
understanding,  which  in  turn  involved  a  great  deal  of  knowledge  about  the  world— in  fact,  it  could  be  argued 
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that  the  more  one  "knows,”  the  more  one  “understands"  each  sentence  one  reads.  And  the  level  of  world 
knowledge  needed  for  any  useful  language-processing  is  much  higher  than  our  original  intuitions  led  us  to 
expect. 

There  has  been  a  serious  debate  about  whether  Al  work  in  computational  linguistics  has  enlightened  us 

at  all  about  the  nature  of  language  (see  Dresher  and  Hornstein,  1976,  and  die  replies  by  Winograd,  1977,  and 

Schank  and  Wilensky,  1977).  The  position  taken  by  Al  researchers  is  dial  if  our  goal  in  linguistics  is  to 

include  understanding  sentences  like  Do  you  have  the  lime?  and  We'll  have  dinner  after  the  kids  wish  their 

hands,  which  involve  die  total  relationship  between  the  speakers,  then  there  is  much  more  to  it  than  die 

syntactic  arrangement  of  words  with  well-defined  meanings — that  although  the  study  in  linguistics  of  die 

systematic  regularities  widiin  and  between  natural  languages  is  an  important  key  to  the  nature  of  language 

and  the  workings  of  the  mind,  it  is  only  a  small  part  of  the  problem  of  building  a  useful  language  processor 

and.  therefore,  only  a  small  part  of  an  adequate  understanding  of  language  (Schank  and  Abelson.  1977): 

For  both  people  and  machines,  each  in  their  own  way,  there  is  a  serious  problem  in  common  of 
making  sense  out  of  what  they  hear,  see,  or  are  told  about  die  world.  The  conceptual  apparatus 
necessary  to  perform  even  a  partial  feat  of  understanding  is  formidable  and  fascinating,  (p.  2) 

l  inguists  have  almost  totally  ignored  the  question  of  how  human  understanding  works. ...  It  has 
nevertheless  been  consistently  regarded  as  important  that  computers  deal  well  with  natural 
language.  .  .  .  None  of  these  high-sounding  things  arc  possible,  of  course,  unless  die  computer 
really  ‘understands’  the  input.  And  that  is  the  theoretical  significance  of  these  practical 
questions — to  solve  them  requires  no  less  dian  articulating  the  detailed  nature  of ‘understanding’. 

If  we  understood  how  a  human  understands.  Uien  we  might  know  how  to  make  a  computer 
understand,  and  vice  versa,  (p.  8) 

Ihis  idea  that  building  Al  systems  requires  the  articulation  of  the  detailed  nature  of  understanding,  diat 
is,  that  implementing  a  theory  in  a  computer  program  requires  one  to  “work  out"  one's  fuzzy  ideas  and 
concepts,  has  been  suggested  as  a  major  contribution  of  Al  research  (Schank  and  Abelson,  1977): 

Whenever  an  Al  researcher  feels  he  understands  the  process  he  is  theorizing  about  in  enough 
detail,  he  then  begins  to  program  it  to  find  out  where  lie  was  incomplete  or  wrong.  .  .  .  The  time 
between  the  completion  of  the  theory  and  the  completion  of  the  program  that  embodies  the  theory 
is  usually  extremely  long.  (p.  20) 

And  Newell  (1970),  in  a  thorough  discussion  of  eight  possible  ways  one  might  view'  the  relation  of  Al  to 
psychology,  suggests  that  building  programs  “forces  psychologists  to  become  operational,  that  is,  to  avoid  the 
fuzziness  of  using  mcntalistic  terms”  (p.  365). 

Certainly  the  original  conception  of  the  machine-translation  effort,  although  it  was  intuitively  sensible. 
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fell  far  shore  of  what  would  be  required  to  enable  a  machine  to  handle  language,  indicating  a  limited 
conception  of  what  language  is.  It  is  in  the  broadening  of  this  conception  that  Al  has  contributed  most  to  the 
study  of  language  (Schank  and  Abelson.  1977,  p.  9).  I'hus.  Al  can  show,  as  in  the  examples  of  chess  and 
language  understanding,  that  intuitive  notions  and  assumptions  about  mental  processes  just  do  not  work . 
Furthermore,  analyzing  die  behavior  of  Al  programs  implemented  on  die  basis  of  existing,  inadequate 
concepts  can  offer  hints  on  how  die  concepts  of  the  theory  affect  die  success  of  its  application. 

Scientific  Languages  and  Theory  Formation 

I.awrence  Miller,  in  a  1978  article  dial  reviews  the  dialogue  between  psychologists  and  Al  researchers 

about  Al’s  contribution  to  the  understanding  of  mind,  concludes  that 

the  critics  of  Al  believe  that  it  is  easy  to  construct  plausible  psychological  theories;  die  difficult 
task  is  demonstrating  dial  diesc  dicories  are  true.  The  advocates  of  A I  believe  dial  it  is  difficult  to 
construct  adequate  psychological  theories;  but  once  such  a  theory  has  been  constructed,  it  may  be 
relatively  simple  to  demonstrate  diat  it  is  true.  (p.  113) 

And  Schank  and  Abelson  (1977)  agree: 

We  are  not  oriented  toward  finding  out  w  hich  pieces  of  our  theory  are  quantifiable  and  testable  in 
isolation.  We  feel  that  such  questions  can  wait.  First  we  need  to  know  if  we  have  a  viable  theory. 

(P  21) 

Just  as  Al  must  consider  the  same  issues  that  psychology  and  linguistics  address,  other  aspects  of  knowledge 
dealt  with  by  other  traditional  disciplines  must  also  be  considered.  For  example,  current  ideas  in  Al  about 
linking  computing  machines  into  coherent  systems  or  cooperative  problem-solvers  forces  us  to  consider  the 
sociological  aspects  of  knowing.  A  fundamental  problem  in  Al  is  communication  among  many  individual 
units,  each  of  which  “knows”  some  things  relevant  to  some  problems  as  well  as  something  about  the  other 
units.  The  form  of  the  communication  between  units,  the  organizational  structure  of  the  complex,  and  the 
nature  of  the  individuals'  knowledge  of  each  other  arc  all  questions  that  must  find  some  engineering  solution 
if  the  apparent  power  of  "distributed  processing"  is  to  be  realized. 

These  issues  have  been  studied  in  other  disciplines,  albeit  from  very  different  perspectives  and  with 
different  goals  and  methods.  We  can  view  the  different  control  schemes  proposed  for  interprocess 
communication,  for  example,  as  attempts  to  design  social  systems  of  knowledgeable  entities.  Our  intuitions, 
once  again,  form  the  specifications  for  die  first  systems.  Reid  G.  Smith  (1978)  has  proposed  a  contract  net 
where  the  individual  entities  negotiate  their  roles  in  attacking  the  problem,  via  requests  for  assistance  from 
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other  processors,  proposals  for  help  in  reply,  and  contracts  indicating  agreement  to  delegate  part  of  the 
problem  to  another  processor;  and  Kornfcld  and  Hewitt  (1981)  have  developed  a  model  explicitly  based  on 
problem  solving  in  the  scientific  community.  Only  after  we  have  been  able  to  build  many  systems  based  on 
such  models  will  we  be  able  to  identify  the  key  factors  in  the  design  of  such  systems. 

lliere  is  another  kind  of  study  of  the  mind,  conducted  by  scientists  who  seek  to  understand  the  workings 
of  the  brain.  The  brain  as  a  mechanism  has  been  associated  with  computing  machines  since  their  invention 
and  has  puzzled  computer  scientists  greatly: 

We  know  die  basic  active  organs  of  the  nervous  system  (the  nerve  cells).  There  is  every  reason  to 
believe  dial  a  very  large-capacity  memory  is  associated  with  this  sy  stem.  We  do  most  emphatically 
not  know  what  type  of  physical  entities  arc  the  basic  components  for  die  memory  in  question. 

(von  Neumann,  1958,  p.  68) 

If  research  on  AI  produces  a  language  for  describing  what  a  computational  system  is  doing,  in  terms  of 

processes,  memories,  messages,  and  so  forth,  then  that  language  may  very  well  be  die  one  in  which  the 

function  of  die  neural  mechanisms  should  be  described  (I.enat,  1981;  Torda,  1982).  And,  as  Herbert  Simon 

(1980)  points  out,  this  functionality  may  be  shared  by  nature’s  other  brand  of  computing  device.  DNA: 

It  might  have  been  necessary  a  decade  ago  to  argue  for  the  commonality  of  the  information 
processes  that  arc  employed  by  such  disparate  systems  as  computers  and  human  nervous  systems. 

The  evidence  for  that  commonality  is  now  overwhelming,  and  die  remaining  questions  about  die 
boundaries  of  cognitive  science  have  more  to  do  with  whether  dierc  also  exist  nontrivial 
commonalities  with  information  processing  in  genetic  systems  than  with  whether  men  and 
machines  both  think,  (p.  45) 

One  more  example  of  die  overlap  of  concerns  between  Al  and  the  related  disciplines  is  die  following. 
Making  it  possible  for  an  individual  to  know  something  about  what  another  knows,  without  actually  knowing 
it,  involves  defining  the  nature  of  what  is  known  elsewhere:  who  the  experts  arc  on  what  kinds  of  problems 
and  what  they  might  know  diat  could  be  useful.  This  relates  directly  to  the  categorization  of  knowledge  that 
is  the  essence  of  library  science.  Instead  of  dealing  with  categories  according  to  which  static  books  will  be 
filed,  however,  AI  must  consider  the  dynamic  aspects  of  systems  that  know  and  learn. 

The  relation,  then,  between  AI  and  disciplines  like  psychology,  linguistics,  sociology,  brain  science,  and 
library  science  is  a  complex  one.  Certainly  our  current  understanding  of  the  phenomena  dealt  w  ith  by  these 
disciplines — cognition,  perception,  memory,  language,  social  systems,  and  categories  of  knowledge— has 
provided  the  intuitions  and  models  on  which  the  first  AI  programs  were  built.  And.  as  has  happened  in 
psychology  and  linguistics,  these  first  systems  may,  in  turn,  show  us  new  aspects  of  the  phenomena  that  we 


have  not  considered  in  studying  their  natural  occurrence.  But,  most  important,  the  development  of  A I 
systems,  of  useful  computer  tools  for  knowledge-oriented  tasks,  will  expose  us  to  many  new  phenomena  and 
variations  that  will  force  us  to  increase  our  understanding. 

The  Practice  of  AI 

Al,  and  computer  science  in  general,  employs  a  unique  method  among  the  disciplines  involved  in 
advancing  our  understanding  of  cognition— building  computers  and  programs,  and  observing  and  trying  to 
explain  patterns  in  the  behavior  of  these  systems.  1110  programs  arc  the  phenomena  to  be  studied  (Newell, 
1981): 

Conceptual  advances  occur  by  (scientifically)  uncontrolled  experiments  in  our  own  style  of 
computing.  .  .  .  The  solution  lies  in  more  practice  and  more  attention  to  what  emerges  there  as 
pragmatically  successful,  (p.  4) 

Observing  our  own  practice — that  is,  seeing  what  the  computer  implicitly  tells  us  about  the  nature 
of  intelligence  as  we  struggle  to  synthesize  intelligent  systems— is  a  fundamental  source  of 
scientific  knowledge  for  us.  (p.  19) 

Thus,  AI  is  one  of  the  "sciences  of  the  artificial,"  as  Herbert  Simon  (1969)  has  defined  them  in  an  influential 
paper.  Half  of  the  job  is  designing  systems  so  that  their  performance  will  be  interesting.  There  is  a  valuable 
heuristic  in  generating  these  designs:  'Hie  systems  that  we  arc  naturally  inclined  to  want  to  build  arc  those 
that  will  be  useful  in  our  environment.  Our  environment  will  shape  them,  as  it  shaped  us.  As  Simon  described 
the  development  of  time-sharing  systems: 

Most  actual  designs  have  turned  out  initially  to  exhibit  serious  deficiencies,  and  most  predictions 
of  performance  have  been  startlingly  inaccurate.  Under  these  circumstances,  the  main  route  open 
to  the  development  and  improvement  of  time  sharing  systems  is  to  build  them  and  see  how  they 
behave,  (p.  21) 

The  Genus  of  Symbol  Manipulators 

Newell  and  Simon's  psychologically  phrased  idea  of  “observing  the  behavior  of  programs"  follows  from 
their  pioneering  research  program  in  what  they  have  called  information  processing  psychology.  Newell  and 
Simon  developed,  in  the  early  years  of  this  enterprise,  some  of  the  first  computer  programs  that  showed 
reasoning  capabilities.  This  research  on  chess-playing,  theorem-proving,  and  problem-solving  programs  was 
undertaken  as  an  explicit  attempt  to  model  the  corresponding  human  behaviors.  But  Newell  and  Simon  took 
the  strong  position  that  these  programs  were  not  to  serve  simply  as  metaphors  for  human  thought  but  were 
themselves  theories.  In  fact,  they  argued  that  programs  were  the  natural  vehicle  for  expressing  theories  in 
psychology: 
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An  abstract  concept  of  an  information  processing  system  has  emerged  with  the  development  of  the 
digital  computers.  In  fact,  a  whole  array  of  different  abstract  concepts  has  developed,  as  scientists 
have  sought  to  capture  the  essence  of  the  new  technology  in  different  ways. . . .  With  a  model  of  an 
information  processing  system,  it  becomes  meaningful  to  try  to  represent  in  some  detail  a 
particular  man  at  work  on  a  particular  task.  Such  a  representation  is  not  metaphor,  but  a  precise 
symbolic  model  on  the  basis  of  which  pertinent  specific  aspects  of  the  man's  problem  solving 
behavior  can  be  calculated.  (Newell  and  Simon,  1972.  p.  5) 

Taking  the  view  that  artificial  intelligence  is  theoretical  psychology,  simulation  (the  running  of  a 
program  purporting  to  represent  some  human  behavior)  is  simply  the  calculation  of  the 
consequences  of  a  psychological  theory.  (Newell,  1973a,  p.  47) 

A  framework  comprehensive  enough  to  encourage  and  permit  thinking  is  offered,  so  that  not  only 
answers,  but  questions,  criteria  of  evidence,  and  relevance  all  become  affected.  (Newell.  1973a, 
p.  59) 


Newell  and  Simon,  in  their  view  that  computer  programs  are  a  vehicle  for  expressing  psychological 

theories  rather  titan  just  serving  as  a  metaphor  for  mental  processes,  were  already  taking  a  strong  position 

relative  to  even  the  new  breed  of  cognitive  psychologists  who  were  talking  in  terms  of  computerlike  mental 

mechanisms.  As  Paul  R.  Cohen  (1982)  puls  it.  in  his  review  of  Al  work  on  models  of  cognition: 

We  should  note  that  wc  have  presented  the  strongest  version  of  die  information-processing 
approach,  that  advocated  by  Newell  and  Simon.  Their  position  is  so  strong  that  it  defines 
information-processing  psychology  almost  by  exclusion:  It  is  die  field  that  uses  methods  alien  to 
cognitive  psychology  to  explore  questions  alien  to  Al.  This  is  an  exaggeration,  but  it  serves  to 
illustrate  why  there  are  thousands  of  cognitive  psychologists,  and  hundreds  of  Al  researchers,  and 
very  few  information-processing  psychologists,  (p.  7) 

However.  Newell  and  Simon  did  not  stop  dicre.  A  further  development  in  dieir  thinking  identified  brains 
and  computers  as  two  species  of  the  genus  of  physical  symbol  systems — the  kind  of  system  dial,  they  argue. 
must  underlie  any  intelligent  behavior. 

At  the  root  of  intelligence  are  symbols,  with  their  denotative  power  and  their  susceptibility  to 
manipulation.  And  symbols  can  be  manufactured  of  almost  anything  that  can  be  arranged  and 
patterned  and  combined.  Intelligence  is  mind  implemented  by  any  patternable  kind  of  matter. 
(Simon,  1980.  p.  35) 

A  physical  symbol  system  has  die  necessary  and  sufficient  means  for  general  intelligent  action. 
(Newell  and  Simon.  1976,  p.  116) 

Information  processing  psychology  is  concerned  essentially  with  whether  a  successful  dieory  of 
human  behavior  can  be  found  within  die  domain  of  symbolic  systems.  (Newell.  1970.  p.  372) 


Flic  basic  point  of  view  inhabiting  our  work  has  been  that  programmed  computer  and  human 
problem  solver  are  both  species  belonging  to  the  genus  IPS.  (Newell  and  Simon.  1972,  p.  869) 


It  is  thia  view  of  computers — as  systems  that  share  a  common,  underlying  structure  with  the  human 
intelligence  system — that  promotes  the  behavioral  view  of  AI  computer  research.  Although  these  machines 
arc  not  limited  by  the  rules  of  development  of  their  natural  counterpart,  they  will  be  shaped  in  their 
development  by  the  same  natural  constraints  responsible  for  the  form  of  intelligence  in  nature. 


The  Flight  Metaphor 

Ihe  question  of  whether  machines  could  think  was  certainly  an  issue  in  the  early  days  of  A I  research, 

although  dismissed  rather  summarily  by  those  w  ho  shaped  the  emerging  science: 

To  ask  whether  these  computers  can  think  is  ambiguous.  In  the  naive  realistic  sense  of  the  term,  it 
is  people  who  think,  and  not  cither  brains  or  machines.  If.  however,  we  permit  ourselves  the 
ellipsis  of  referring  to  the  operation  of  live  brain  as  Thinking,"  then,  of  course,  our  computers 
“think."  (McCulloch,  1964,  p.  368) 

Addressing  fundamental  issues  like  this  one  in  their  early  writing,  several  researchers  suggested  a  parallel  with 
the  study  of  flight,  considering  cognition  as  another  natural  phenomenon  that  could  eventually  be  achieved 
by  machines: 

Today,  despite  our  ignorance,  we  can  point  to  that  biological  milestone,  the  thinking  brain,  in  the 
same  spirit  as  the  scientists  many  hundreds  of  years  ago  pointed  to  the  bird  as  a  demonstration  in 
nature  that  mechanisms  heavier  than  air  could  fly.  (Feigcnbaum  and  Feldman.  1963,  p.  8) 

It  is  instructive  to  pursue  this  analogy  a  bit  farther.  Flight,  as  a  way  of  dealing  with  the  contingencies  of 

the  environment,  takes  many  forms— from  soaring  eagles  to  hovering  hummingbirds.  If  we  start  to  study 

flight  by  examining  its  forms  in  nature,  our  initial  understanding  of  what  we  arc  studying  might  involve  terms 

like  feathers,  wings,  weight-to-wing-size  ratios,  and  probably  wing-flapping,  too.  This  is  the  language  we 

begin  to  develop — identifying  regularities  and  making  distinctions  among  the  phenomena.  But  when  we  start 

to  build  flying  artifacts,  our  understanding  changes  immediately: 

Consider  how  people  came  to  understand  how  birds  fly.  Certainly  we  observed  birds.  But  mainly 
to  recognize  certain  phenomena.  Real  understanding  of  bird  flight  came  from  understanding 
flight;  not  birds.  (Papcrt,  1972,  pp.  1-2) 

Kvcn  if  we  fail  a  hundred  times  at  building  a  machine  that  flics  by  flapping  its  wings,  we  learn  from  every 

attempt.  And  eventually  we  abandon  some  of  the  assumptions  implicit  in  our  definition  of  the  phenomena 

under  study  and  realize  that  flight  docs  not  require  wing  movement  or  even  wings: 

Intelligent  behavior  on  the  part  of  a  machine  no  more  implies  complete  functional  equivalence 
between  machine  and  brain  than  flying  by  an  airplane  implies  complete  functional  equivalence 
between  plane  and  bird.  (Armcr,  1963,  p.  392) 
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Kvcry  new  design  brings  new  data  about  what  works  and  what  docs  not,  and  clues  as  to  why.  Kvery  new 
contraption  tries  some  different  design  alternative  in  the  space  defined  by  our  theory  language.  And  every 
attempt  clarifies  our  understanding  of  what  it  means  to  fly. 

But  there  is  more  to  the  sciences  of  the  artificial  than  defining  the  “true  nature”  of  natural  phenomena. 
The  exploration  of  the  artifacts  themselves,  the  stiff-winged  flying  machines,  because  they  arc  useful  to 
society,  will  naturally  extend  the  exploration  of  the  various  points  of  interface  between  the  technology  and 
society.  While  nature’s  exploration  of  the  possibilities  is  limited  by  its  mutation  mechanism,  human  inventors 
will  vary  every  parameter  they  can  think  of  to  produce  effects  that  might  be  useful — exploring  the  constraints 
on  the  design  of  their  machines  from  every  angle.  1'he  space  of  “flight"  phenomena  will  be  populated  by 
examples  that  nature  has  not  had  a  chance  to  try. 


Exploring  the  Space  of  Cognitive  Phenomena 

This  argument,  that  the  utility  of  intelligent  machines  will  drive  the  exploration  of  their  capabilities, 
suggests  that  the  development  of  Al  technology  has  begun  an  exploration  of  cognitive  phenomena  that  will 
involve  aspects  of  cognition  that  arc  not  easy  to  study  in  nature.  In  fact,  as  with  die  study  of  flight,  Al  will 
allow  us  to  sec  natural  intelligence  as  a  limited  capability,  in  terms  of  the  design  trade-offs  made  in  the 
evolution  of  biological  cognition: 

Computer  science  is  an  empirical  discipline.  . . .  Each  new  machine  that  is  built  is  an  experiment. 

. . .  bach  new-  program  that  is  built  is  an  experiment.  It  poses  a  question  to  nature,  and  its  behavior 
offers  clues  to  an  answer. . . .  We  build  computers  and  programs  for  many  reasons.  We  build  them 
to  serve  society  and  as  tools  for  carrying  out  the  economic  tasks  of  society.  But  as  basic  scientists 
we  build  machines  and  programs  as  a  way  of  discovering  new  phenomena  and  analyzing 
phenomena  we  already  know  about.  .  .  .  The  phenomena  surrounding  computers  arc  deep  and 
obscure,  requiring  much  experimentation  to  assess  their  nature.  (Newell  and  Simon,  1976,  p.  1 14) 

For  what  will  Al  systems  be  useful?  How  will  they  be  involved  in  die  economic  tasks  of  society?  It  has 
certainly  been  argued  that  this  point  is  one  diat  distinguishes  biological  systems  from  machines  (Norman, 

1980): 


1’he  human  is  a  physical  symbol  system,  yes.  with  a  component  of  pure  cognition  describablc  by 
mechanisms.  .  .  .  But  the  human  is  more:  The  human  is  an  animate  organism,  with  a  biological 
basis  and  an  evolutionary  and  cultural  history.  Moreover,  the  human  is  a  social  animal,  interacting 
with  others,  with  die  environment,  and  with  itself.  Hie  core  disciplines  of  cognitive  science  have 
tended  to  ignore  these  aspects  of  behavior,  (pp.  2-4) 

1’he  difference  between  natural  and  artificial  devices  is  not  simply  dial  they  arc  constructed  of 
different  stuff;  their  basic  functions  differ.  Humans  survive,  (p.  10) 
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Tools  evolve  and  survive  according  to  their  utility  to  the  people  who  use  them,  hither  the  users  find  belter 

tools  or  their  competitors  find  them.  This  process  w  ill  certainly  continue  with  the  development  of  cognitive 

tools  and  w  ill  dramatically  change  the  way  we  think  about  Al: 

We  measure  die  intelligence  of  a  system  by  its  ability  to  achieve  suited  ends  in  the  face  of 
variations,  difficulties  and  complexities  posed  by  the  task  environment,  i  bis  general  investment 
of  computer  science  in  attaining  intelligence  . . .  becomes  more  obvious  as  we  extend  computers  to 
more  global  complex  and  knowledge-intensive  tasks— as  we  attempt  to  make  diem  our  agents, 
capable  of  handling  on  their  own  the  full  contingencies  of  die  natural  world.  (Newell  and  Simon, 

197b.  pp.  114-115) 

In  fact,  this  change  has  already  begun  in  Al  laboratories,  but  the  place  where  die  changing  perception  of  Al 
systems  is  most  dramatic  and  accelerated  is,  not  surprisingly  in  our  society,  die  marketplace. 

Al,  Inc. 

To  date,  three  of  die  emerging  Al  technologies  have  attracted  interest  as  commercial  possibilities:  robots 
for  manufacturing,  natural-language  front-ends  for  information-retrieval  systems,  and  expert  systems.  Ihe 
reason  that  a  company  like  General  Motors  invests  millions  of  dollars  in  robots  for  die  assembly  line  is  not 
scientific  curiosity  or  propaganda  about  “retooling"  dicir  industry.  GM  believes  diesc  robots  arc  essential  to 
its  economic  survival.  Al  technology  will  surely  change  many  aspects  of  American  industry,  but  its 
application  to  real  problems  will  just  as  surely  change  the  emerging  technology— change  our  perception  of  its 
nature  and  of  its  implications  about  knowledge.  Hie  remaining  discussion  will  focus  on  this  issue  in  the 
context  of  expert  systems. 

Expert  Systems 

With  work  on  the  DKNDRAL  system  in  the  mid-1960s,  Al  researchers  began  pushing  work  on 

problem-solving  systems  beyond  constrained  domains  like  chess,  robot  planning,  blocks-world  manipulations. 

and  puzzles:  I  hey  started  to  consider  symbolically  expressed  problems  that  were  known  to  be  difficult  for  the 

best  human  researchers  to  solve  (see  1  indsay,  Buchanan,  Feigenbaum,  and  I  .ederberg,  1980). 

One  needs  to  move  toward  task  environments  of  greater  complexity  and  openness — to  everyday 
reasoning,  to  scientific  discovery,  and  so  on.  The  tasks  we  tackled,  though  highly  complex  by  prior 
psychological  standards,  still  are  simple  in  many  respects.  (Newell  and  Simon,  1972,  p.  872) 

Humans  have  difficulty  keeping  track  of  all  of  the  knowledge  that  might  be  relevant  to  a  problem,  exploring 

all  of  the  alternative  solution -paths,  and  making  sure  none  of  the  valid  solutions  is  overlooked  in  the  process. 

Work  on  DKNDRAl .  showed  that  when  human  experts  could  explain  exactly  what  they  were  doing  in  solving 

their  problems,  the  machine  could  achieve  expert-level  performance. 


Continued  research  at  Stanford's  Heuristic  Programming  Project  next  produced  die  MYCIN  system.  .111 
experiment  in  modeling  medical  diagnostic  reasoning  (Shortliffe,  1976),  In  production  ruin  of  the  form  If 
<eonJition>  then  <uctum>.  Shortliffe  encoded  die  kind  of  information  about  the  reasoning  processes  of 
physicians  that  they  were  most  able  to  give — advice  about  what  to  do  in  certain  situations.  In  other  words,  the 
if  part  of  the  rules  contains  clauses  that  attempt  to  differentiate  a  certain  situation,  and  the  then  part  describes 
what  to  do  if  one  finds  oneself  in  that  situation.  This  production -rule  knowledge  representation  worked 
surprisingly  well:  MYCIN  was  able  to  perform  its  task  in  a  specific  area  of  infectious-disease  diagnosis  as  well 
as  the  best  experts  in  the  country. 

furthermore,  the  MYCIN  structure  was  seen  to  be,  at  least  to  some  extent,  independent  of  the  domain  of 
medicine.  So  long  as  experts  could  describe  their  knowledge  in  terms  of  If.  .  .  then  .  .  .  rules,  the  reasoning 
mechanism  that  MYCIN  used  to  make  inferences  from  a  large  set  of  rules  would  come  up  with  the  right 
questions  and.  eventually,  a  satisfactory  analysis.  MYCIN-like  systems  have  been  successfully  built  in 
research  laboratories  for  applications  as  diverse  as  mineral  exploration,  diagnosis  of  computer-equipment 
failure,  and  even  advising  users  about  how  to  use  complex  systems. 

Transfer  of  Expertise 

ITicre  is  an  important  shift  in  the  view  of  expert  systems  just  described  that  illustrates  the  changing 
perspective  on  Al  that  is  likely  to  take  place  as  it  becomes  an  applied  science.  The  early  work  on  expert 
systems,  building  on  Al  research  in  problem  solving,  focused  on  representing  and  manipulating  the  facts  in 
order  to  get  answers.  But  through  MYCIN.  whose  reasoning  mechanism  is  actually  quite  shallow,  it  became 
clear  that  the  way  that  these  systems  interacted  with  the  people  who  had  the  knowledge  and  with  those  who 
needed  it  was  an  important,  deep  constraint  on  the  system's  architecture — on  its  knowledge  representations 
and  reasoning  mechanisms: 

A  key  idea  in  our  current  approach  to  building  expert  systems  is  that  these  programs  should  not 
only  be  able  to  apply  the  corpus  of  expert  knowledge  to  specific  problems,  but  they  should  also  be 
able  to  interact  with  the  users  and  experts  just  as  humans  do  when  they  learn,  explain,  and  teach 
what  they  know. .  .  .  These  transfer  of  expertise  (TOT)  capabilities  were  originally  necessitated  by 
“human  engineering"  considerations — the  people  who  build  and  use  our  systems  needed  a  variety 
of  “assistance"  and  "explanation  "  facilities.  However,  there  is  more  to  the  idea  of  101*  titan  the 
implementation  of  needed  user  features:  These  social  interactions — learning  from  experts, 
explaining  one's  reasoning,  and  teaching  what  one  knows — are  essential  dimensions  of  human 
knowledge.  They  arc  as  fundamental  to  the  nature  of  intelligence  as  expert-level  problem-solving, 
and  they  have  changed  our  ideas  about  representation  and  about  know  ledge.  (Harr.  Bennett,  and 
Clanccy,  1979,  p.  1) 
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Randall  IXivis's  (1976)  THIRFSIAS  system,  built  within  the  MYC1N  framework,  was  the  first  to  focus  on 

the  transferral  aspects  of  expert  systems.  T11RKS1AS  offered  aids  for  the  experts  who  were  entering 

knowledge  into  the  system  and  for  the  system's  users.  For  example,  in  order  for  an  expert  to  figure  out  why  a 

system  has  come  up  with  the  wrong  diagnosis  or  is  asking  an  inappropriate  question,  he  (or  she)  has  t" 

understand  its  behavior  in  his  own  terms:  The  system  must  explain  its  reasoning  in  terms  of  concepts  and 

procedures  with  which  the  expert  is  familiar,  flic  same  sort  of  explanation  facility  is  necessary  for  the 

eventual  user  of  an  expert  system  who  will  want  to  he  assured  that  the  system's  answers  are  well  founded. 

Hxpert-sv stems  technology  had  to  he  extended  to  facilitate  such  interactions,  and.  in  the  process,  out 

conception  of  what  an  expert  system  was  had  changed.  No  longer  did  the  systems  simply  solve  problems: 

they  now  transferred  expertise  liom  people  who  had  it  to  people  who  could  use  it: 

We  are  building  systems  that  take  part  in  the  human  activity  of  transfer  of  expertise  among  experts, 
practitioners,  and  students  in  different  kinds  of  domains.  Our  problems  remain  the  same  as  they 
were  before:  We  must  find  good  ways  to  represent  knowledge  and  meta-knowledge,  to  carry  on  a 
dialogue,  and  to  solve  problems  in  the  domain.  Rut  the  guiding  principles  of  our  approach  and 
the  underly  ing  constraints  on  our  solutions  have  subtly  shifted:  Our  systems  arc  no  longer  being 
designed  solely  to  be  expert  problem  solvers,  using  vast  amounts  of  encoded  knowledge.  There 
are  aspects  of  "knowing"  that  have  so  far  remained  unexplored  in  A I  research:  By  participation  in 
human  transfer  of  expertise,  these  systems  will  involve  more  of  die  fabric  of  behavior  that  is  the 
reason  we  ascribe  know  ledge  and  intelligence  to  people.  (Barr.  Bennett,  and  Clancey,  1979.  p.  5) 

The  Technological  Niche 

It  is  tire  goal  of  those  who  arc  involved  in  the  commercial  development  of  expert-systems  technology  to 
incorporate  that  technology  into  some  device  drat  can  be  sold.  But  dre  environment  in  which  expert  systems 
operate  is  our  own  cognitive  environment:  it  is  within  this  sphere  of  activity — people  solving  their 
problems — that  the  eventual  expert-system  products  must  be  found  useful.  They  nil!  be  engineered  to  our 
minds. 

With  drese  systems,  it  will  at  last  bcconrc  economical  to  match  human  beings  in  real  time  with 
really  large  machines.  This  means  that  we  can  work  toward  programming  wlrat  will  be,  in  elTcct, 
"thinking  aids.”  In  the  years  to  come  we  expect  that  these  man-machine  systems  will  share,  and 
perhaps  for  a  time  be  dominant,  in  our  advance  toward  the  development  of  "artificial 
intelligence."  (Minsky,  1963,  p.  450) 

It  is  a  long  way  from  the  expert  systems  developed  in  the  research  laboratories  to  any  products  that  fit  into 
people's  lives;  in  fact,  it  is  difficult  even  to  envision  what  such  products  will  be.  Fgon  I.ocbncr  of  Hewlett- 
Packard  l  aboratories  tells  of  a  conversation  he  had  many  years  ago  w  ith  Vladimir  Zworykin,  the  inv  entor  of 
television  technology.  I.ocbncr  asked  Zworykin  what  he  had  in  mind  for  his  invention  when  he  was 
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developing  the  technology  in  the  ll)20s—  what  kind  of  product  he  thought  his  efforts  would  produce.  The 
inventor  said  tii.it  he  had  had  a  very  clear  idea  of  the  eventual  use  of  I'V:  lie  envisioned  medical  students  in 
the  gallery  of  an  operating  room  getting  a  clear  picture  on  their  I  V  screens  of  the  details  of  the  operation 
being  conducted  below  them. 

One  cannot,  at  the  outset,  understand  llie  application  of  a  new  technology,  because  it  will  find  its  way 

into  realms  of  application  that  do  not  yet  exist.  I  .oehner  has  described  this  piocess  in  terms  of  the 

hr/iihiloi’iail  nit  he,  paralleling  modern  evolution  theory  (I  oehner.  197(,;  |  oehner  and  burden.  1%'J).  I  ike 

the  species  and  their  environment,  inventions  and  their  applications  aie  co -defined •  -they  constantly  evolve 

together,  w  ith  niches  representing  periods  of  relative  stability .  into  a  new  reality : 

Moreover,  the  niches  themselves  are  .  .  .  defined  in  considerable  measure  by  the  whole 
constellation  of  organisms  themselves.  1  here  can  he  no  lice  without  hairy  heads  for  them  to 
inhabit,  nor  animals  without  plants.  (Simon,  1980,  p.  44) 

llius.  technological  inventions  change  as  they  are  applied  to  people's  needs,  and  the  activities  dial  people 

undertake  change  with  die  availability  o f  new  technologies.  And  as  people  in  industry  try  to  push  the  new 

technology  toward  some  profitable  niche,  they  w  ill  also  explore  die  nature  of  the  underlying  phenomena.  Of 

course,  it  is  not  just  the  scientists  and  engineers  who  developed  the  new  technology  who  tire  involved  in  this 

exploration:  Half  of  the  job  involves  finding  out  what  the  new  capabilities  can  do  for  people. 

Recognition  of  the  commercial  application  of  TV  technology  was  accomplished  by  David  Sarnoflf.  after 
the  model  he  had  used  for  the  radio  broadcasting  industry.  It  is  important  to  note  that  the  "commercial 
product"  that  resulted  from  TV  technology,  the  TV-set  receiver,  was  only  part  of  a  gigantic  system  dial  had  to 
be  developed  for  its  support  (actually  imported  from  radio,  with  modifications  and  extensions),  involving 
broadcast  technology,  die  networks,  regulation  of  the  air  waves,  advertising,  and  so  forth.  I. oehner  refers  to 
this  need  for  systemwide  concern  with  product  development  as  die  Fdisonian  model  of  technological 
innovation:  I  dison's  achievement  of  the  invention  of  die  long-life,  commercially  feasible  light  bulb  was 
conducted  m  parallel  with  his  successful  development  of  the  first  dynamo  for  commercially  producing  electric 
power  and  with  his  design  and  implementation  of  the  first  clcctric-povvcr  distribution  network. 

The  Knowledge  Industry 

Among  the  scien'ific  disciplines  that  study  knowledge,  the  potential  for  commercial  applications  of 
artificial  intelligence  presents  unique  opportunities.  To  identify  and  fill  the  niches  in  which  intelligent 
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machines  will  survive,  we  must  ask  questions  about  "knowledge"  from  a  rather  different  perspective.  We 
must  identity  die  role  that  die  various  aspects  of  intelligence  play,  or  could  play,  in  the  affairs  of  men,  in  such 
a  way  that  we  can  identify  correctable  shortcomings  in  how  things  are  done. 

There  is  no  question  that  the  current  best  design  of  an  intelligent  system,  the  human  brain,  has  its 
limitations.  Computers  have  already  helped  people  deal  with  such  shortcomings  as  memory  failure  and 
confusions,  overloading  in  busy  situations,  their  tendency  to  boredom,  and  their  need  for  sleep.  These 
extended  capabilities— total  recall,  rapid  processing,  and  uninterrupted  attention— are  cognitive  capabilities 
dial  we  have  been  willing  to  concede  to  the  new  species  in  the  genus  of  symbol  tnunif'uluhm.  They  have 
helped  us  do  the  tilings  we  did  before,  and  have  made  some  entirely  new  capabilities  possible,  for  example, 
airline  reservation  systems,  24-hour  banking,  and  I’ac-Man  (although  die  truly  challenging  computer  “games" 
are  set  to  come!).  Intelligence  is  also  going  to  be  present  in  diis  new  species,  as  envisioned  20  years  ago  by 
Marvin  Minsky  (1963): 

1  believe  .  .  .  that  we  are  on  die  direshold  of  an  era  that  will  be  strongly  influenced,  and  quite 
possibly  dominated,  by  intelligent  problem-solv  ing  machines,  (p.  406) 

f  inding  a  wav  to  apply  this  new  intellectual  capability,  for  effectively  applying  relevant  experience  to  new 

situations,  is  die  task  ahead  for  Al,  Inc. 

We  have  hardly  begun  to  understand  what  this  abundant  and  cheap  intellectual  power  will  do  to 
our  lives.  It  has  already  started  to  change  physically  die  research  laboratories  and  the 
manufacturing  plants.  It  is  difficult  for  the  mind  to  grasp  die  ultimate  consequences  for  man  and 
society.  (Riboud,  1979) 

It  may  be  a  while  in  coming,  and  it  may  involve  a  rcdiinking  of  the  way  we  go  about  some  cognitive  activities. 
But  it  is  extremely  important  that  the  development  of  intelligent  machines  be  pursued,  for  the  human  mind 
not  only  is  limited  in  its  storage  and  processing  capacity  but  it  also  has  known  bugs:  It  is  easily  misled, 
stubborn,  and  even  blind  to  die  truth,  especially  when  pushed  to  its  limits. 

And.  as  is  nature's  way.  everything  gets  pushed  to  the  limit,  including  humans.  We  must  find  a  way  of 
organizing  ourselves  more  effectively,  of  bringing  together  the  energies  of  larger  groups  of  people  toward  a 
common  goal.  Intelligent  systems,  built  from  computer  and  communications  technology,  will  someday  know 
more  than  any  indiv  idual  human  about  what  is  going  on  in  complex  enterprises  involv  ing  millions  of  people, 
such  as  a  multinational  corporation  or  a  city.  And  they  will  be  able  to  explain  each  person's  part  of  die  task. 
Wc  will  build  more  productive  factories  this  way,  and  maybe  someday  a  more  peaceful  world.  We  must  keep 


: — 

in  miiul,  following  our  analogy  of  flight,  that  the  capabilities  of  intelligence  as  it  exists  in  nature  arc  not 
necessarily  its  natural  limits: 


'there  are  other  facets  to  this  analogy  with  flight;  it,  too,  is  a  continuum,  and  some  once  thought 
that  the  speed  of  sound  represented  a  boundary  beyond  which  flight  was  impossible.  (Armcr, 
1963,  p.  398) 
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